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lation between the different time scales and the spatial heterogeneities originated in the ground 
state topology, which are associated to the presence of a backbone structure. We perform numer- 
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reach large system sizes. We present evidence supporting both the idea of a growing process in the 
preasymptotic regime of the glassy phases and the existence of a backbone structure behind this 
processes. 
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I. INTRODUCTION 

It has became clear during the past years that when 
studying the general class of systems with slow dynam- 
ics, the heterogeneous character of both spatial and dy- 
namical properties plays a fundamental role [2-0| • F° r 
instance, the increasing interest in the heterogeneous be- 
havior of glasses and related complex systems during the 
past decade is concomitant with the fact that its under- 
standing is of great significance for a complete compre- 
hension of the glass transition problem. In this direction, 
both dynamical and spatial heterogeneities have been 
studied in several systems such as colloids 0411 > granular 
matter structural fl8U22l ] and spin glasses [23l — 

An important question concerns the key relation be- 
tween dynamical and spatial heterogeneities. Studies in 
structural glasses revealed that a relation clearly exists, 
and much effort has been devoted to identify the involved 
mechanisms that characterize it. In contrast, spin glasses 
have shown to be more elusive regarding possible links 
between spatial and dynamical heterogeneities. It has 
recently been shown that a direct connection between 
dynamical and spatial heterogeneities is present in the 
± J Edwards- Anderson (EA) model [29|, both in two and 
three dimensions j3(>j33| . 

Dynamical heterogeneities in the low temperature dy- 
namics of spin-glass models can be characterized through 
the mean flipping-time distribution (MFTD) [30| . which 
gives information on the amount of spins flipping events 
within a given time window. For the two-dimensional ± J 
EA model, where a spin-glass phase does not exist (T g = 
0) but preasymptotic slow dynamics can be observed at 
low temperatures, it has been shown that this distribu- 
tion develops two characteristic peaks when the temper- 
ature is decreased [3l|. There is a first temperature- 
independent peak at short time scales characterizing fast 



degrees of freedom, and a second peak at large time 
scales which is thermally activated and is related to the 
slow-degrees of freedom. This strong dynamical het- 
erogeneity has been related to the underlying spatial 
hetero gene ities given by the backbone structure of the 
model [3ll l32l |. The backbone structure is a constrained 
structure fully characterized by the topological proper- 
ties of the ground state. In particular, for the ±JEA 
model, an analysis of the degenerate configurations of 
the ground state reveals different sets of spins: on the one 
hand solidary spins which form a ferromagnetic-like state 
and on the other hand non-solidary spins which can be 
seen as paramagnetic-like. This property naturally links 
to the information obtained through the MFTD: non- 
solidary (paramagnetic-like) and solidary (ferromagnetic- 
like) spins can be recast as responsible of the fast and slow 
degrees of freedom, respectively. 

The fact that solidary spins have a ferromagnetic-like 
character has been reinforced by information obtained 
with the three-dimensional ±J EA model. In this case 
there exists a spin-glass phase at low temperatures (below 
T g = 1.12 (HI) and again the strong dynamical hetero- 
geneities observed in the MFTD can be directly related 
to the backbone structure obtained using ground state 
information [33[. More importantly, it has been shown 
that following only the set of solidary spins a domain 
growth process can be identified [33j]- The observed do- 
main growth dynamics intuitively suggests the idea of a 
characteristic growing length in the system. 

The key obstacle in these studies concerns the identi- 
fication of the backbone structure, which is limited by 
the difficulty to properly identify ground state configura- 
tions. Given the high degeneracy of the ground state of 
the ± J EA model, this sets a finite size constraint, and 
thus only systems with very small sizes can be resolved. 
At the same time, the definition of the backbone struc- 
ture for the ± J EA model is based on the degeneracy of 
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the ground state and on the Ising character of the spin 
variable. A generalization to systems with only a simple 
degenerated ground state (i.e. with up-down symmetry), 
such as the Gaussian model, is far from being straight- 
forward [35l |36| . The generalization to non-Ising spin 
systems, such as XY or Potts models, is also an impor- 
tant open issue. 

In this work, in order to gain insight into the ingre- 
dients which should be taken into account for a gener- 
alization of the definition of the backbone structure, we 
first analyze the relation between dynamical and spatial 
heterogeneities in the two-dimensional Potts model with 
ferromagnetic couplings. This model appears as a good 
candidate: it has a ground state with a very low de- 
generacy with only q ground state configurations and it 
also has a very rich low temperature dynamics with many 
qualitatively different regimes [13, HI]. Furthermore, new 
numerical computation platforms allows for large system 
sizes to be reached, reducing finite size effects and also 
allowing for very long time regimes (39|. Moreover, we 
extend our analysis and also consider a frustrated version 
of the Potts model, the ± J Potts model in two dimen- 
sions, which can be regarded as a generalization of the 
±J EA model to q available states for each spin. Our 
analysis reveals evidence of the presence of a backbone 
structure in this model. 

The outline of the paper is as follows. In Sec. |TT] we de- 
fine the models we are interested in, i.e. the Potts model 
with ferromagnetic and ±J couplings. We also define 
the MFTD used in this work to characterize dynamical 
heterogeneities and give detailed information on numeri- 
cal implementations based on graphics processing units. 
Then, in Sec. IIII1 studying the Potts model with q = 9 
and ferromagnetic couplings we show that the MFTD 
is directly related to the underlying coarsening process. 
Section |IV] is devoted to the two-dimensional ± J EA 
model, where we show that the MFTD suggests the pres- 
ence of a domain growth process even in the preasymp- 
totic low temperature regime (T > T g = 0). Finally, in 
Sec. |V]we analyze the ± J Potts model for different val- 
ues of q and present results that reveal the presence of a 
backbone structure in this case. Section fVTl is devoted to 
a discussion of the presented results. 



II. MODELS AND GPU-BASED NUMERICAL 
IMPLEMENTATION 

The Potts model 

The Hamiltonian for the g-state Potts model is [4(| 
H = -J'£6(s i ,s j ), (1) 

where J > 0, s; = l,2,...,q, the sum runs over pairs 
of nearest-neighbors sites on the square lattice of linear 
dimension L and N = L 2 sites, and S(si,Sj) is the Kro- 



necker delta function |4l| . This Hamiltonian favors ferro- 
magnetic states with two neighbors minimizing its energy 
when their spin variables Si are in the same state q; the 
energy of the pair being — J. The energy of a frustrated 
bond, i.e. Si ^ Sj, is always zero and therefore the energy 
of the first excitation over the ground state is 4J. The 
transition between the paramagnetic high-temperature 
state and the ferromagnetic low-temperature state, in 
two dimensions, is a second order transition for q < 4 
and a first order transition for q > 4 ■ The transition 
temperature in the square lattice is exactly known, and 
is given by T c = 1/ ln(f + ^fq). 

Recently, it has been shown that the dynamical be- 
havior at low temperatures presents a rich variety of 
regimes [37j , which can be ordered in a temperature scale. 
These regimes can be observed after a sudden quench 
from the high temperature paramagnetic state (typically 
a fully disordered state corresponding to T = 00) to dif- 
ferent working temperatures T < T c . If the working 
temperature is below but close to T c the dynamics is 
governed by nucleation events, just up to T n < T c . Be- 
low T n and above a temperature T co coarsening phenom- 
ena rules the dynamics, signaled by a power-law decaying 
energy relaxation. Below T co , blocked states (stripes or 
honeycomb-like configurations) preempts fully develop- 
ment of coarsening dynamics. This regime is therefore 
characterized by coarsening at intermediate stages of the 
dynamics and blocked states at late stages, which when 
occurring dominate the relaxation process. For q > 4, at 
smaller temperatures (below some temperature T g ) the 
coarsenin g re laxation is interrupted by a so called glassy 
state [37], I421J441 ] . This glassy regime is characterized by 
dynamical frustration in such a way that the infinite-time 
and zero-temperature limit state has an excess energy 
with respect to the ground state. At finite temperature 
when exiting from the glassy state the system can get 
stuck again in a blocked state. So, below T g glassy and 
blocked states govern the dynamics. The relative range 
of the observed dynamical regimes depends on q. For 
example, for q = 9 one has that the critical tempera- 
ture is T c = 0.72134752J, the nucleation temperature 
is T„ w 0.7I8J w 0.995T C , the coarsening temperature 
is T co w 0.6J ~ 0.832T C , and the glass temperature is 
T g w 0.2 J w 0.277T C |7|. 



The ±J Potts model 

In the case of the ± J Potts model we use the following 
Hamiltonian 

H = -J2i S ( J v> s i) + S ( J V> -!)(! - S ( s ^ s i))} > 

(ij) 

(2) 

where the Jy- are 1 or — 1 with equal probability; = 1 
favors a ferromagnetic state (as in the non-disordered 
case), while J = — I favors unequal neighbor states 
(,Sj 7^ Sj). In this model the ground state is multiply- 
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degenerated with the number of configurations exponen- 
tially growing with the system size. Mean field stud- 
ies suggest that this model develops ferromagnetic or- 
der at finite temperatures (45j . However, as discussed in 
Ref. |4(|, there is no evidence for a ferromagnetic phase 
in finite dimensional models. Although in three dimen- 
sions this system has a low temperature spin-glass phase, 
with a glass transition temperature decreasing with in- 
creasing q [i^, H3| , the two-dimensional counterpart has 
T g = and no spin-glass phase for all q (as is the case for 
the two-dimensional ± J EA model). Nevertheless, in two 
dimensions, the low temperature dynamics becomes ex- 
tremely slow when decreasing the temperature and has 
some characteristics similar to a true spin-glass phase. 
This is the slow preasymptotic dynamical regime we will 
be interested in when analyzing the two-dimensional ± J 
Potts model in Sees. IIVI andfVl 



Quantities of interest and numerical implementation 
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We use a Monte Carlo dynamical approach with 
Metropolis transition rates. The same simulation pro- 
tocol is used for the Potts models with ferromagnetic 
and ± J couplings. Starting from a completely disordered 
state (infinite temperature) we quench the system to a 
fixed working temperature T at time t = 0. The key char- 
acterization tool we use is the MFTD. It measures the 
distribution of time scales associated to flipping events 
in the system, and it has proven to be a good quantity 
to expose time scale separation and thus dynamical het- 
erogeneities. We measure the number of flips Np done 
by every spin between any two of the possible q states in 
a time window At = t — t w , where the waiting time t w 
corresponds to the time elapsed from the quench done at 
t = 0. The mean flipping time formally depends on both 
t and t w and is simply defined as r = At/Np. From this 
quantity we construct the MFTD P(t), which is typically 
shown as P(log 10 r) due to its broadness. For clarity, the 
time evolution of the MFTD is followed using At = t w . 
Results for other values of At and t w are qualitatively 
similar. 

In the last few years the use of graphics processing 
units (GPUs) to accelerate simulations has burst out in 
many areas of physics including fluid models, gravitation 
and superconductivity j48l - l50j . In particular, in Statis- 
tical Physics many works have been devoted to report 
implementations of spin models on GPU architectures 
(see [5l|, [HJ and references therein). These recent re- 
ports alert us about the tremendous benefit of working 
with CPU's implementations, which reduce significantly 
the simulation times. For our numerical simulations in 
the present work, we use CPU-based parallel implemen- 
tations of the Potts models. Among other benefits, the 
GPU-implementation of these models allowed us to work 
with system sizes up to N = 8192 2 for the ferromagnetic 
model, and up to N = 16384 2 for the ± J Potts model. 
Averages where taken over m thermal realizations for the 



FIG. 1. (Color online) (a) Relaxation of the excess energy 
for different temperatures for the q = 9 Potts model, (b) 
Dependence with temperature of the MFTD for the q — 9 
Potts model (colors and symbols for each temperature are 
conserved from the panel above). All the curves correspond 
to At = t w = 4 x 10 3 , L = 8192, m = 100. 



ferromagnetic case and over M disorder realizations for 
the ± J Potts case. Details on the numerical implemen- 
tation of the Potts model with ferromagnetic couplings 
can be found in Ref. [2^]. For further technical details 
see the Appendix „ [53[ . 



III. POTTS MODEL WITH q = 9 

In this Section we will analyze the MFTD for the q = 9 
Potts model for different dynamical regimes. When low- 
ering the temperature below and close to T c the system 
rapidly passes the nucleation regime and enters the coars- 
ening regime since T n « 0.995T C . This can be shown by 
the evolution of the relaxation function defined as the 
normalized excess of energy 



e(t) — e(oo) 
e(0) -e(oo)' 



(3) 



where e(t) = (H)/N is the average energy per spin and 
e(oo) is the equilibrium energy of the system. Since this 
quantity relies on the value of e(oo) it is very difficult to 
obtain it for glassy systems, due to extremely long relax- 
ation times. For this reason we have only analyzed §e for 
the characterization of the different dynamical regimes 
of the Potts model [37j . Given a quench to a working 
temperature T < T c the relaxation function shows, after 
a short transient, an evolution depending on tempera- 
ture. In a wide temperature range 0.2T C < T < 0.98T C 
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FIG. 2. (Color online) Evolution with the waiting time of 
the MFTD for the q = 9 Potts model at T = 0.98T C (within 
the coarsening regime). The time evolution is followed using 
a two-times protocol with At = t w . Averages were taken 
with L = 8192, m = 100. The inset shows the evolution 
of the relaxation function 4>E(t) at this temperature. The 
vertical dashed line indicates approximately the beginning of 
the power law decay corresponding to the coarsening regime 
(t«4x 10 3 ). 



one observes a power- law decay of the relaxation function 
4>e ~ t~ x l 2 , as shown in Fig.[TJa). This is consistent with 
a coarsening dynamics where the size of the domains are 
growing as I ~ t 1 / 2 [54[. Subsequently, the appearance of 
a glassy state slows down the dynamics, appreciated as a 
plateau in the relaxation function, which finally saturates 
in a finite value when T — > 0. 

The MFTD is measured in the coarsening regime by 
choosing At = t w = 4 x 10 3 . At temperatures close 
enough to T c the MFTD is expected to be character- 
ized by a single peak at small time scales, typical of 
fast flipping events. Nevertheless, even at a tempera- 
ture T = 0.999T C the MFTD shows a shoulder at larger 
time scales. From this shoulder, a well defined second 
peak develops when lowering the temperature inside the 
coarsening regime, as shown in Fig. [IJb). The interpre- 
tation of the first and second peak in the MFTD when 
the system is in the coarsening regime is clear: while the 
second peak is related to thermal excitations within one 
of the q-states ferromagnetic domains, the first peak is 
associated to the fast flipping events of spins belonging to 
domain walls between the different growing domains [33j . 

It is also possible to follow the time evolution of the 
MFTD at a given fixed temperature by changing t w , us- 
ing At = t w . Figure [2] shows the MFTD for different 
waiting times t w at T = 0.98T C , which corresponds to 
the coarsening regime. As shown by the evolution of the 
relaxation function in the inset, the power-law decay be- 
gins at a time t « 4 x 10 3 . It is worth stressing that 
the evolution from a MFTD with a single peak into a 
bimodal distribution starts manifesting before this time, 
nevertheless it is still clearly related to the coarsening 
process. The growth of the second peak with time indi- 
cates that the number of spins within ferromagnetic do- 



mains is increasing. The first peak is not only decreasing 
but it is also moving to the right, indicating that flipping 
transitions arc becoming harder for those spins partici- 
pating in domain walls. It is also worth stressing that 
spins which belongs to a given ferromagnetic domain can 
eventually be part of a domain wall in a subsequent time, 
i.e. a given spin can contribute to either of the two peaks 
of the MFTD distribution while the coarsening process 
is developing. 

When the temperature is lowered in the q — 9 Potts 
model, the dynamics becomes slower as the different tem- 
perature scales are overpassed. In this case a glassy state 
starts dominating the dynamics and the relaxation func- 
tion is characterized by a plateau [13 (see Fig. [1]). Due 
to the presence of this plateau, the second peak moves to 
larger flipping time values and eventually becomes diffi- 
cult to characterize. 

We have shown in this Section that the MFTD can 
be related to the domain growth process in the coarsen- 
ing regime of the q — 9 Potts model. In order to ex- 
tend this analysis to a disordered model, and since it has 
been recently suggested that a coarsening process takes 
place within the backbone of the three-dimensional ± J 
EA model [33] , in the following sections we will consider 
in our analysis the ± J Potts model. As a starting point 
we will consider the ± J q — 2 case, i.e. the ± J EA model. 
Then, we will also consider larger values of q which shows 
the importance of considering of the backbone structure 
in Potts models. 



IV. ±J EA MODEL 

In this section we move to the study of disordered sys- 
tems first analyzing the ±J EA model. Wc first briefly 
discuss the results already found for the ±J EA model 
in relation with dynamical heterogeneities and the back- 
bone structure, which is defined based on information 
given by the topology of the ground state . Con- 
cretely, those bonds which do not change their state - sat- 
isfied or frustrated - in all configurations of the multiply 
degenerated ground state of the model compose the rigid 
lattice. Besides, those spins connected through the rigid 
lattice are labeled as solidary spins, since they do main- 
tain their relative orientation in all ground state configu- 
rations. The rest of the spins are labeled as non-solidary 
spins. Both the rigid lattice and the set of solidary spins 
form the backbone structure of the system. 

In Ref. [H[ the three-dimensional ±J EA model was 
studied and slow and fast time scales were related to 
the spatial heterogeneities given by the backbone struc- 
ture. Evidence was presented for a growing process tak- 
ing place inside the backbone structure, where spins can 
be ordered in a ferromagnetic-like state. In this case, 
the backbone structure has a finite component percolat- 
ing all over the sample where ferromagnetic-like correla- 
tions can grow [35l ] . The situation is different in the two- 
dimensional ±J EA model [HI, HH, where the backbone 
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FIG. 3. (Color online) MFTD for the ±J EA model (equiv- 
alently ±J Potts model with q — 2) in two dimensions for 
T = 0.25 J and At = t w = 10 6 . We show the full MFTD for 
L — 22 and L — 512 using spin flip dynamics with serial ran- 
dom updates together with the result for L = 512 using the 
parallel dynamics described in Sec. [TTJ The separation of the 
full MFTD into the contributions from solidary spins (ss) and 
non-solidary spins (nss) is also shown for L = 22. Averages 
were taken over M = 2000 samples for L = 22 and M = 100 
samples for L = 512. 




FIG. 4. (Color online) Evolution of the MFTD given by the 
solidary spins in the two-dimensional ±J EA model. Each 
curve was obtained using At = t w . The temperature is T = 
0.25 J in all cases. The arrow emphasizes how the contribution 
to the fast peak is evolving with increasing t w . Averages were 
taken within M = 2000 samples for L = 22. 

structure is fragmented and does not percolate through 
the sample. However, it has been shown that the distri- 
bution of islands of the backbone structure is very close to 
the one corresponding to the percolation threshold [35|. 
If one considers the possibility of growing ferromagnetic- 
like correlations inside each fragment of the backbone 
structure in the two-dimensional case, then a growing 
process would take place with a cut off given by the non- 
percolative character of the backbone structure. In the 
following we further test this idea. 

First, in Fig. [3] we show the full MFTD and its sepa- 
ration into the contribution of solidary and non-solidary 



spins, according to the backbone structure obtained from 
ground state information. In this case At = t w = 10 6 and 
the temperature is T = 0.25J > T c = 0, at which the 
dynamics is sufficiently slow, i.e. in the preasymptotic 
glassy regime. The separation is reported for the linear 
size of the system L = 22, larger than the one reported 
in Ref. [3l| • Again this separation perfectly accounts for 
the observed dynamical heterogeneities. 

The numerical simulations showing the separation of 
the MFTD into its contributions from solidary and non- 
solidary spins for L = 22 were performed using single 
spin flip dynamics with Metropolis transition probabili- 
ties and random updates. Moreover, the full MFTD is 
compared in Fig. [3] with the one for L = 512 obtained 
with the same dynamical rules, showing a considerable 
agreement. This indicates that although L = 22 seems to 
be a rather small system size it already perfectly accounts 
for the main dynamical properties of the system. One 
can also compare this result with the one obtained using 
the GPU-based parallel implementation. The MFTD for 
L = 512 and L = 16384 (almost indistinguishible be- 
tween them) obtained with this dynamical rules are also 
presented in Fig. [3] and the agreement with the serial im- 
plementation is excellent. This validates the use of this 
dynamical rules for the present dynamical studies, i.e. 
there are not significant differences between serial and 
parallel spin flip updates. 

Finally, we show in this section the evolution of the 
contribution of solidary spins to the MFTD correspond- 
ing to the two-dimensional ± J EA model. We show re- 
sults for T = 0.25J and in the range 10 3 < At = t w < 
10 7 , where the full MFTD remains mostly unchanged. 
From the evolution of the contribution of solidary spins 
to the MFTD presented in Fig. |H it can be observed 
that while the second peak remains almost unchanged, 
the first peak is disappearing (or moving to the right). 
This can be taken as an indication of the presence of a 
growing process inside the backbone structure as previ- 
ously reported for the three-dimensional case [331 ] . Note 
also the similarities between this result and the one ob- 
tained for the Potts model with ferromagnetic couplings 
in Fig. [3J The second peak of the contribution of sol- 
idary spins to the MFTD, corresponding to slow degrees 
of freedom, is not evolving with t w . Indeed, the second 
peak only depends on temperature an is thermally acti- 
vated [3l|, as further discussed below. 



V. ±J POTTS MODEL 

In this section we extend the study of the MFTD to the 
two-dimensional ± J Potts model with different q values 
using GPU-based numerical simulations. We will com- 
pare the full MFTD for different q values and discuss its 
temperature dependence. Figure [5] shows the MFTD for 
the ±J Potts model with different number of available 
states q = 2,3,5,10 for each spin and using T = 0.1J 
and At = t w — 10 7 . One can observe that at this low 
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FIG. 7. (Color online) Arrhenius plot for the characteristic 
FIG. 5. (Color online) MFTD for the ± J Potts model with time gcale of the second peak ^ of the MFTD for g = 2 , 3, 5 

different g-states, q = 2, 3, 5, 10, at a fixed temperature T = (At = t„ = 10 7 ). The dashed lines are linear fits of the data 

0.1J. Curves correspond to At = t w = 10 , L = 4096 and ( symbo l s ), giving slopes of 1.99 ± 0.01 for the q = 2 case and 

M - 10 - 0.99 ± 0.01 for q = 3 and q = 5 cases. 
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FIG. 6. (Color online) MFTD for the ±J Potts model model 
with q = 5, At — t w = 10 7 , and different temperatures as 
indicated. Curves correspond to L = 2048, M = 10. 



temperature the MFTD can be decomposed on at least 
two peaks, thus revealing the strong nature of the ob- 
served heterogeneous dynamics. Comparing the curve 
for q = 2 showed in this figure (T = 0.1 J) with the one 
showed in Fig. [3] (T — 0.25 J), we see that the second 
peak is moved out to the right due to thermal activation. 
However, for q = 3, 5, 9 the time scale of the second peak 
is within the time window. For values of q > 2 one can 
envisage the presence of more than two peaks, as is more 
clear for q = 10, suggesting a more complex underlying 
structure. 

The existence of the strong time-scale separation ob- 
served in Fig. [5] can be attributed to the presence of an 
underlying backbone structure. In order to further pur- 
sue this idea we show in Fig. [6] the temperature depen- 
dence of the MFTD for q = 5 and At = t w = 10 7 . The 
first peak characterizing fast degrees of freedom does not 
change appreciably with temperature. The second peak, 
related to the slow degrees of freedom, moves to larger 
values of the mean flipping time scale when the tem- 



perature is decreased. Indeed, the average position of 
the second peak can be thought of as a characterization 
of the states with lowest excitation energies in the sys- 
tem. Figure [7] shows that the average position of the 
second peak, T2, is thermally activated for different q 
values (q = 2,3,5). The activation energy is AE = 2J 
for q = 2 and AE = J for q > 2. This can be understood 
by inspection of the Hamiltonian @ presented in Sec.HTl 
While for the q = 2 case the lowest excitations corre- 
spond to flipping one spin with only one frustrated bond, 
for q > 2 the lowest excitation is given by flipping one 
spin with two frustrated bonds. In both cases the final 
excited state has three frustrated bonds. This therefore 
clearly shows that the structure around the second peak 
is thermally activated, which we take as another indica- 
tion of a growing process inside the backbone structure. 



The dynamical properties described here for the ±J 
Potts model implicitly point to the presence of a set of 
strongly correlated spins, reminiscent of the set of sol- 
idary spins in the ±J EA model. The presented evi- 
dence therefore suggest the existence of a backbone struc- 
ture in the ±J Potts model. This backbone structure 
would be composed of solidary spins of a ferromagnetic- 
like character and non-solidary spins with paramagnetic- 
like features. Interestingly, although we have presented 
evidence for the presence of a backbone structure in the 
± J Potts model, it is not straightforward to compute it 
from ground state information. In fact, due to the in- 
ternal variable q in each spin, the protocol to obtain the 
backbone structure used for q = 2 should be generalized. 
This task, which is clearly far from trivial, will be left for 
future work. 
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VI. DISCUSSIONS AND CONCLUDING 
REMARKS 

In the present work we have studied the dynamical 
heterogeneities characterized through the MFTD in the 
Potts model with both ferromagnetic and ± J couplings. 
We have also devoted our analysis to relate these dy- 
namical heterogeneities with the presence of a backbone 
structure. 

First, we showed how the MFTD accounts for the dif- 
ferent dynamical regimes observed in the q = 9 Potts 
model. In particular, by analyzing the system in the 
coarsening regime one can give support to the idea that 
the temperature and time evolution of the two peaks in 
the MFTD are intimately related to the coarsening of 
different domains. 

We showed that for the two-dimensional ± J EA model 
(equivalently the ± J Potts model with q = 2), where the 
backbone structure is well characterized, the time evolu- 
tion of the MFTD strongly suggests that a growth pro- 
cess is taking place within the preasymptotic regime. We 
have also analyzed the MFTD for the ±J Potts model 
with q > 2. We have shown numerical evidence sug- 
gesting that this model also has an underlying backbone 
structure. In particular the thermal activation of the 
time scale related to the second peak indicates that a 
backbone structure can be the key ingredient dominat- 
ing the glassy dynamics. As a by-product, we have also 
shown the equivalence between serial and parallel imple- 
mentations of the numerical simulations, a fact that can 
not be assumed a priori. 

Since we have presented numerical evidence for the 
plausibility of the existence of a backbone structure in 
the ±J Potts model, the question of how to identify this 
backbone structure naturally arises. The most trivial test 
one can think of is to use the backbone structure obtained 
for q — 2 to analyze the dynamical properties for q > 2. 
In this way one can test whether the spin degrees of free- 
dom are relevant or not in defining the backbone. We 
have run such test and we observed that the rigid lattice 
defined in the two-dimensional ±J EA model does not 
give a proper time scale separation for q > 2. From this 
simple test we can assure that the backbone structure is 
a non-trivial combination of the spin degrees of freedom 
and the couplings distribution. 
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Appendix: GPU-based numerical implementation 

For our numerical simulations we use GPU-based par- 
allel implementations of the Potts models. In particu- 
lar a checkerboard scheme with parallel spin flip updates 
is used. It is worth stressing that although equilibrium 
measures arc accepted as independent of the particular 
Monte Carlo implementation, this is not usually the case 
for the dynamical properties of a model [55| . In princi- 
ple, a parallel implementation of a stochastic dynamics 
could introduce undesirable correlations, and thus should 
be tested beforehand. Here, we have checked that our 
GPU-based massively parallel implementation is com- 
pletely compatible with the usual serial CPU-based dy- 
namics (see Sec. IIV[) where spins are chosen at random 
to attempt each update, and this was done for a totally 
out-of-cquilibrium quantity such as the MFTD. 

On the base of the code presented in Rcf. [39[ some 
modifications were implemented to allow for the con- 
struction of the MFTD histograms and introduce com- 
petitive interactions in the ±J Potts model. For the 
non-disordered case we have just added a few lines to 
the update routine to keep count of the number of flips 
of each spin in the time window we are interested in, and 
a routine to calculate the P(r) histograms using that 
information. Since an additional write operation to an 
array in global memory is necessary at each local update 
step, we get a slowdown of 5 to 10% with respect to the 
reference code, at an average spin-flip-timc of 0.2ns. Is it 
worth stressing that we are still simulating at more than 
120x with respect to a CPU implementation. 

For the ±J Potts model the extension is straightfor- 
ward. In a naive implementation, we have stored the Jij 
bonds in an array in global memory. Every spin has di- 
rect access to the value of the four bonds shared with 
its nearest neighbors. Even more, the information of the 
bonds is duplicated in global memory. This array is built 
in such a way that neighbors threads can copy down the 
values of their bonds to register accessing in a coalesced 
manner. This implementation suffers a slowdown of 16% 
with respect to the non-disorder case, but still has an ac- 
ceptable performance (0.22ns per spin flip on a GTX 480 
[56j ) for a spin-glass code as compared with other imple- 
mentations of realistic system sizes [57| . As compared 
with the C code used for the serial numerical simulations 
of the ± J EA model, the present GPU-based implemen- 
tation represents a speed up of 60x. In both cases, to 
calculate the MFTD a routine to build the histograms is 
implemented using atomic operations on shared memory. 

The implementation of a random number generator 
in GPU should be carefully chosen (for a recent review 
see (Hi) As in Ref. [H we have used the Multiply- With- 
Carry random number generator which allows for the si- 
multaneous generation and use of several independent 
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random sequences, and has a good trade-out of pcrfor- mance and statistical quality, at least for spin systems 

implementations. 
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